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Abstract  -  Scheduling  is  inevitable  and  an  integral  part  of 
hospital  management.  Effective  patient  scheduling  can 
improve  hospital  service  quality  by  minimizing  the 
waiting/stay  time  for  patients  in  the  hospital  and  operation 
efficiency  by  optimizing  the  utilization  of  resources.  However, 
in  practice,  the  schedulers  usually  take  substantial  amount  of 
time  to  do  the  scheduling  manually  and  also  by  using  various 
traditional  scheduling  algorithms.  Motivated  by  the  real  needs 
in  hospital  environments  this  paper  focuses  on  finding  an 
optimal  schedule  using  search  based  optimization  techniques 
like  Genetic  Algorithm  (GA)  and  multi-Agents.  Agents  have 
been  proved  to  be  an  effective  approach  to  resource  allocation 
because  of  its  coordination  and  social  abilities.  Exact  methods 
such  as  branch  and  bound  method,  and  dynamic 
programming  take  considerable  computing  time  and 
hardware  requirements  in  this  application  domain. 
Considering  the  crucial  time  in  the  hospital  environments, 
combinatorial  search  space  algorithms  (like  GA)  with 
precedence  constraints  have  been  selected  to  find  a  good 
solution  with  the  following  objectives:  Customer  satisfaction 
and  Operational  Efficiency.  Customer  satisfaction  is  achieved 
by  minimizing  the  waiting  time  for  patients  and  operational 
efficiency  by  minimizing  the  idle  time  of  the  resource. 

Index  Terms  -  Patient  Scheduling,  Operational  Efficiency, 
Agents,  Customer  Satisfaction 

I.  INTRODUCTION 

The  managerial  aspect  of  providing  health 
services  to  patients  in  hospitals  is  becoming  increasingly 
important.  Hospitals  want  to  reduce  costs  and  improve  their 
financial  assets,  on  the  one  hand,  while  they  want  to 
maximize  the  level  of  patient  satisfaction,  on  the  other 
hand.  Patient  Scheduling  is  the  process  of  scheduling  and 
sequencing  the  patients  for  various  multiple  resources  in 
health  care  domain.  The  multiple  constraints  and  multiple 
goals  to  be  achieved  in  minimal  time  makes  this  problem 
highly  complex.  The  social  abilities  allow  agents  to 
interact  with  each  other  to  reach  their  own  goals  that  help 
realize  adaptiveness  and  dynamism  [1][2][3].  Agents  also 
have  the  ability  to  represent  specific  constraints  and 
preferences  as  goals  and  plans  which  play  a  major  role  in 
many  hospital  scheduling  problems. 

As  various  researches  in  GA  was  in  progress  a 
powerful  automated  GA  based  patient  scheduling  for 
highly  constrained  situations  developed  by  Vili  in  1997 
guaranteed  to  produce  feasible  solution  not  breaking  any  of 
the  required  constraints  [4]  [5].  In  this  system  schedules 


were  initially  selected  by  random  and  they  were  calculated 
against  the  fitness  function  and  the  fitness  is  expected  to  be 
improved  by  basic  genetic  operators  like  crossover  and 
mutation.  This  method,  together  with  the  whole  process  of 
schedule  generation  showed  the  important  parameters  to 
direct  the  evolution  for  using  GA  for  optimizing  time 
constraints  in  patient  scheduling. 

II.  RELATED  WORK 

A.  Problem  Domain 

Hospital  Patient  Scheduling  is  an  inherently 
distributed  problem  because  of  the  way  real  hospitals  are 
organized  [6].  Moreover  the  treatment  plan  is  dynamic 
because  it  changes  with  respect  to  time.  Each  department 
maintains  a  high  degree  of  independence  and  authority. 
Each  department  also  has  its  own  policies  and  preferences 
regarding  the  scheduling  of  their  patients  and  allocation  of 
the  resources.  Hence  this  domain  is  a  highly  dynamic  and 
an  effective  solution  for  patient  scheduling  will  improve 
the  quality  of  life  in  the  society. 

B.  Literature  Survey 

Many  studies  have  examined  the  scheduling 
problems  for  providing  on  time  services  for  hospitals  [7]. 
However,  each  scheduling  problem  has  its  own 
characteristics  [8]  [9].  In  Ref.  [10]  industrial  management, 
the  multi-agent  scheduling  is  formulated  as  a  sequencing 
game  and  in  project  scheduling,  its  concerned  with 
negotiation  which  takes  place  between  agents  to  resolve 
conflicts  when  the  schedules  become  unacceptable  [11]. 

III.  GENETIC  ALGORITHM  BASED  CMPS  SYSTEM 

The  system  design  of  the  Coordinated  Multi-agent 
based  Patient  Scheduling  System  (CMPS)  using  Genetic 
Algorithm  is  presented  below  in  Fig.  1.  The  design  and 
implementation  of  this  system  follows  the  object-oriented 
approach.  The  CMPS  system  contains  four  main  actors:  the 
patient  agent,  the  resource  agent,  schedule  agent  and 
common  agent.  The  common  agent  is  the  entry  point  to  this 
system  where  the  patients  are  consulted  and  registered. 
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Figure  1 .  System  Design  of  GA  based  CMPS 

The  treatment  plan  and  priority  of  each  patient  and 
resource  is  generated  by  this  common  agent.  The  optimal 
schedule  is  generated  by  the  scheduling  agent  using  genetic 
algorithm.  The     proposed     system    uses     genetic 

algorithm  to  generate  the  schedule  in  minimal  time.     An 
outline  of  the  basic  steps  used  by  CMPS  system  is  dealt 
below  in  few  steps. 

A.  Encoding 

This  algorithm  uses  a  completion  time-based 
encoding,  where  each  gene  is  of  the  form  (i,  j,  C;j)  and  the 
length  of  the  chromosome  varies  as  per  the  number  of 
operations  at  time,  t.  A  sample  encoding  scheme  for  the 
problem  given  in  the  Table  1  is  given  Fig.  2. 

B.  Initial  Population 

The  initial  population  of  50%  of  total  number  of 
combinations  with  respect  to  the  number  of  resources  and 
patient  agents  at  a  particular  time-t  in  the  CMPS  system 
was  selected  in  random  and  calculated  for  its  fitness  value. 

C.  Fitness  Evaluation 

The     multi-objective    patient     scheduling    with 
available  constraints  and  functionality  related  resources  is 
formulated  as  follows, 
1.   Let  Pj  =  {P;}  !<;<„,  index  i  be  the  set  of  patients  to  be 
scheduled  and  are  independent  to  each  other 
Each  patient  Pf  has  a  set  of  medical  therapies  called  as 
operational  task.  Let  Ojkj  be  the  therapy  k  that  has  to 
be  undergone  by  the  patient,  Pj  in  the  resource,  j 
Let  R={Rj}Kj<m,  index  j  be  the  set  of  m  medical 
resources 

4.  Each  resource,  Rj  can  process  only  one  operational 
task  at  a  time 

5.  Each  operational  task,  Ojkj  is  processed  without 
interruption  on  the  resource  Rk  for  a  period  of  Pikj 
time  units 

Two  objectives  which  has  been  used  to  evaluate 
the  fitness  of  the  schedule,  L  is  as  follows, 

1 .  Minimization  of  the  patient' s  waiting  time 

2.  Maximization  of  resource  utilization  by  minimizing 
the  idle  time  of  the  resource 


2. 


3. 


where, 


(1) 


W(l)  -Total  waiting  time  of  Patient 
1(1)  -Idle  time  of  the  medical  resource  for  the  schedule,  L 
P(l)  -Penalty  value 

Table  1  Sample  Problem 
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Patients 
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Resources 

Processing 
Time 
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3 
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1, 

2, 

3, 

2) 

3) 

6) 

6) 

8) 

1) 

3) 

4) 

Figure  2.  Schedule  Encoding 

The  most  important  parameter  used  to  measure  the 
customer  satisfaction  is  in  terms  of  total  waiting  time  of  'n' 
patients  at  time  't'  in  a  schedule  (1)  is  measured  by  the 
formula  as  given  below. 

w'(0  =  ElUafciO)  -4(0-%  (o )      (2) 

where, 

pt  -priority  of  the  patient  that  indicate  the  preference  of 

patient  i 

C  (I) 

1        -completion  time  of  patient  i  in  the  schedule  1 
i  v/  -arrival  time  of  patient  i  in  the  schedule  1 

r  en 

1  v  •'  -execution  time  of  patient  i  in  the  schedule  1 
Another    important    parameter    used     is    the    resource 
utilization  which  is  measured  in  terms  of  idle  time  of  the 
resource  given  by, 

'(0=  TZowiOjCO)  0) 

where, 

Wj  -weight  of  the  resource 

I;  i.Jj  -Idle  time  of  resources  j  in  the  schedule  1 

The  penalty  function  is  a  summation  of  two  other 
sub-penalty  functions,  r(L)  and  c(L)  defined  as  follows, 
=  lVi£  P,  Vj  e  Oi} 

at  timet  (4) 

,  Otherwise 


*       =  \ 
Atjm        } 


where, 
1. ;/  O  .  is  treated  on  resource  m 

at  time  t 

0.  Otherwise 


Vi 


"  \  wt,  (CiJr  -  Birj+1,r).  Other  wise 

m 

D.  Crossover  and  Mutation 

In  this  proposed  system  an  order-based  crossover 
and  insertion  type  mutation  with  respect  to  the  priority  are 
used.  The  likelihood  of  applying  crossover  is  typically 
between  0.6  and  1.0.  Normally  after  crossover,  each  child 
is  allowed  to  go  through  mutation  with  low  rate  of  0.1%  to 
1%  probability. 
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IV.  RESULTS  AND  DISCUSSION 

The  basic  framework  is  implemented  in  Java 
platform  using  JADE.  The  experimental  design  is  outlined 
below  and  it  was  carried  out  in  a  HP  Pavilion  dv6000 
laptop  with  Intel  Pentium  Dual  Core  processor  T2250  at  a 
speed  of  1.73GHz  and  1GB  RAM. 

A.     Performance  Evaluation  Metric 

The  performance  of  the  proposed  framework  is 
evaluated  using  the  performance  metrics  like  total 
completion  time,  total  waiting  time  and  total  ideal  time. 
The  schedule  generated  for  the  3X3  benchmark  problem  in 
Table  2  for  the  traditional  scheduling  algorithms  such  as 
(First  Come  First  Serve)  FCFS,  (Earliest  Due  Date  first) 
EDD,  (Longest  Processing  time  first)  LPT,  (Shortest 
Processing  time  first)  SPT  and  WSPT  (Weighted  Shortest 
Processing  Time  first)  using  MS.  LEKIN  [12]  software  is 
shown  in  Fig.  4. 

There  can  be  several  performance  metrics  used  for 
evaluating  this  CMPS  system.  The  objective  of  patient 
scheduling  problem  is  to  minimize  patient  waiting  time  and 
improve  the  resource  utilization  in  the  hospitals. 

The  following  performance  metrics  are  used  in 
evaluating  the  objective  of  the  system. 

1.  Completion  Time  (Q)  -  This  metric  for  an  i  patient 
Pi  refers  to  the  time  at  which  all  operations  0;j 
completes  its  operation  in  the  specified  resource. 

2.  Total  Completion  Time  (  Q)  -  The  total  completion 
time  metric  represents  the  summation  of  the 
completion  time  (Cj)  of  all  patients. 

3.  Patient  Waiting  Time  (Wj)  -  This  metric  is  the 
difference  between  the  patient  arrival  time  and 
completion  time  of  patient  i  at  time  t. 

4.  Total  Patient  Waiting  Time  (  WO  -  The  metric  is 
measured  by  calculating  the  summation  of  the  Patient 
duration  for  all  patients  at  time  t. 

5.  Ideal  Time  (Ik)  -  The  resource  ideal  time  metric  is  the 
difference  between  the  working  time  of  the  resource  k 
and  the  final  completion  time. 

6.  Total  Ideal  Time  (  Ik)  It  is  the  summation  of  the  ideal 
time  for  all  the  resources  at  time  t. 

Table  2:  3X3  Benchmark  problem 


Patients 

Weight 

Wj 

Due  date 
di 

Resource  (processing  time) 
rJ(Pij) 

1 

4 

10 

1(3),  2(1),  3(6) 

2 

6 

10 

3(3),  2(7),  2(1) 

3 

2 

12 

1(2),  3(4),  2(4) 

Figure  4.  Performance  for  traditional  Scheduling  Techniques 
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V.  CONCLUSION 

The  Coordinated  Multi-agent  based  patient 
scheduling  system  using  Genetic  Algorithm  is  designed 
and  implemented.  This  framework  is  simulated  using 
JADE  as  a  middleware  in  Java  platform  for  a  3X3 
benchmark  problem  which  can  be  further  tested  for  larger 
problems.  The  agent  based  solution  makes  this  system 
more  flexible  and  robust.  Application  of  search  based 
optimization  techniques  like  Genetic  Algorithm  to  a  highly 
time-constrained  patient  scheduling  domain  will  surely 
benefit  the  system  by  minimizing  the  schedule  generation 
time  and  hardware  requirements.  Hence  this  provides  an 
effective  and  efficient  method  to  find  a  qualitative  schedule 
with  the  basic  objective  of  customer  satisfaction  and 
operational  efficiency. 


References 


[i] 


I.Vermeulen,  S.  Bohte,  K.  Somefun,  and  H.La  Poutre, 
"Multi-agent  Pareto  appointment  exchanging  in  hospital 
patient  scheduling,"  Service  Oriented  Computing  and 
Applications,  vol.1,  no.3,  pp.  185- 196,  Nov.  2007. 

Marinagi  C.C.,  Spyropoulos  CD.,  Patatheodorou  C,  and 
Kokkotos  S.,  "Continual  planning  and  scheduling  for 
managing  patient  tests  in  hospital  laboratories,"  Artificial 
Intelligence  in  Medicine  20  (2),  pp.  139-154,  2000. 

L.Michael  Woolridge,'7ln  Introduction  to  Multiagent 
S>'.vfem",Second  Edition,  John  Wiley  and  Sons.Ltd.,2009, 
ISBN  10-0470519460. 

Villi  Podgorelec  and  P.Kotal,  "Genetic  Algorithm  Based 
System  for  Patient  Scheduling  in  Highly  Constrained 
Situations,"  Journal  of  Medical  Systems,  Springer 
Netherlands,  Volume  21,  Number  6,  December  1997. 

L.Giovanni  and  F.Pezzela,  "An  Improved  Genetic  Algorithm 
for  Distributed  and  flexible  jobshop  scheduling  problem," 
Journal  of  Operational  Research,  2009. 

T.  O.  Paulussen,  N.R.  Jennings,  K.S.  Decker,  and  A.  Heinzl, 
"Distributed  patient  scheduling  in  hospital,"  International 
Joint  Conference  on  Artificial  Intelligence,  vol.  18,  pp.  1224- 

1232,2003. 

Brandeau  M.L.,  Sainfort  F.,  and  Pierskalla  W.P.,  "A 
Handbook  of  Methods  and  Applications,"  Operations- 
Research  and  Health  Care:  Kluwer  Academic  Publishers, 
Boston,  MA,  2004. 

D.  Karger,  C.  Stein,  and  J.  Wein,  "Scheduling  Algorithms," 

1997. 

CD.    Spyropoulos,    "AI   planning   and   scheduling    in   the 
medical    hospital    environment,"    Artificial    Intelligence    in 
Medicine,  vol.20,  no.2,  pp.  101-1 1 1,  2000. 
[10]  Hamers    H.,    P.    Borm,    and    S.    Tijs,    "On    games 

corresponding  to  sequencing  situations  with  ready  times," 
Mathematical  Programming,  Vol.  70,  pp. 1-13,  1995. 
[11]  Kim  K.,  B.C.  Paulson,  C.J.  Petrie,  and  V.R.  Lesser, 

"Compensatory  negotiation  for  agent-based  project  schedule 
coordination,"     CIFE     working     paper     No.55,     Stanford 
University,  Stanford,  CA,  1999. 
[12]  LEKIN,  The  Stern  School  of  Business,   New  York 

University,  New  York,  2001. 


[2] 

[3] 

[4] 

[5] 
[6] 

[7] 

[8] 
[9] 


20 


tVACEEE 


